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METHOD FOR PROVIDING 
VIDEO ENHANCED ELECTRONIC MAIL RETURN RECEIPTS 

BACKGROUND OF THE INVENTION 

In a conventional paper mail context, return receipts provide valuable information to senders 
of mail. With the return receipt, the sender can verify that the intended recipient received the 
mail where otherwise the sender would have to rely on, for example, contacting the recipient 
directly to confirm that the mail was received. Similarly, in an electronic mail context, return 
receipts are available to provide the sender of an electronic mail message some feedback as to the 
status of their electronic mail message. For example, the electronic mail message return receipt 
may provide information such as if the electronic mail message was received, opened or deleted 
unread. 

However, the major drawback of prior art electronic mail return receipts is that, while 
helpful, current incarnations of these return receipts are still very impersonal. For example, no 
current return receipt provides the ability to see the electronic mail message recipient's facial 
expression/reaction when reading the electronic mail message. 

Accordingly, it would be desirable to have a method for improving the shortcomings of 
prior art electronic mail message return receipts. It would be further desirable to have a method 
for providing an electronic mail message return receipt which provides some feedback as to the 
electronic mail message recipients' reaction to reading the electronic mail message. 
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SUMMARY OF THE INVENTION 

The present invention is an electronic mail message return receipt which includes video of 
the electronic mail message recipient reading the electronic mail message. In the present 

5 invention, a first user (message sender or originator) composes an electronic mail message which 
specifies at least one electronic mail message recipient for which an electronic mail message 
return receipt is required. The electronic mail message is sent to the recipient and when the 
electronic mail message is opened by the recipient, a video capture of the electronic mail 
message recipient is initiated, such as via a video capturing device at the electronic mail message 

10 recipient's end. 



□ The video capturing device records the recipient while the electronic mail message recipient 

5 reads the message. The video capturing device then stops recording when the electronic mail 

y message recipient stops reading the message. A return receipt is then sent to the first user which 

i!5 includes the video of the electronic mail message recipient reading the electronic mail message. 

" 5 i The first user can then watch the electronic mail message recipient reading the message and thus 

„ can see the recipient's reaction when reading the electronic mail message. In one embodiment, 

ti the return receipt may be an electronic mail message provided to the sender with the video of the 

f| recipient attached thereto. In one embodiment, audio may also be provided along with the video. 
^0 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 shows an exemplary configuration for providing electronic mail message return 
receipts with video enhancement in accordance with the teachings of the present invention. 

FIG. 2 is a flow chart of an exemplary method in accordance with the teachings of the 
present invention. 

FIG. 3 shows an exemplary screen display in accordance with the teachings of the present 
invention. 

FIG. 4 is a flow chart of another exemplary method in accordance with the teachings of 
the present invention. 
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DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

The present invention is a method for providing improved electronic mail message 
5 receipts between two or more electronic mail message users. Referring to FIG. 1, an exemplary 
configuration for implementing the present invention is shown. In this exemplary embodiment, 
an electronic mail message originator or sender employs an electronic mail message compatible 
device, such as a personal computer 110 having a display screen 130 to at least send an electronic 
mail message 140 to one or more designated electronic mail message recipients. In the present 
10 invention, electronic mail message originator 100 specifies that he/she would like a electronic 

mail message return receipt associated with the receipt of electronic mail message 140 by one or 
3 more of the designated electronic mail message recipients, such as by electronic mail message 
S recipient 150. 

i!5 Electronic mail message recipient 150 also employs an electronic mail message 

\l compatible device, such as a personal computer 160 having a display screen 170. Additionally, a 
^ video capturing device 1 80 is coupled to the personal computer 160 in a manner as known in the 
art. Upon receiving electronic mail message 140, it is contemplated that electronic mail message 
p recipient 150 will some time thereafter read the electronic mail message 140. Typically, this is 
120 accomplished by electronic mail message recipient selecting and "opening" the electronic mail 
message 140 from within some electronic mail message facility or software. In the present 
invention, upon "opening" of the electronic mail message 140, the video capturing device 180 is 
activated to begin capturing the video of electronic mail message recipient reading electronic 
mail message 140. Upon the closing, minimizing of electronic mail message 140 or at some 
25 predetermined time later, the video capturing is terminated and a return receipt 190 having the 
captured video of electronic mail message recipient 150 is provided back to electronic mail 
message originator 100. 
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In the present invention, the electronic mail message users, such as electronic mail 
message originator 100 and electronic mail message recipient 150 communicate and interact with 
each other over a communications network, such as the Internet, which may be provided to the 
user via a broadband network connection, Integrated Services Digital Network (ISDN) line, 
5 conventional telephone line, or other similar network. In the present invention, at least one of 
the communicating parties, such as electronic mail message recipient 150 should have a device 
capable of capturing video of the electronic mail message recipient 150 reading the electronic 
mail message. The video capturing device may also have the capability to capture audio of the 
electronic mail message recipient 150, such as via a microphone which may be coupled to the 
10 video capturing device. It is contemplated that the electronic mail message originator also have 
such a video capturing device. 

Software is typically provided on computers 220 and 230 which interacts with the video 
*f display screens 240 and 250 and the video cameras 260 and 270 during a video call/conference to 
i!5 render and provide images of the call/conference participants to one another during the 
"d call/conference. Typically the images of the call/conference participants are provided via video 
~ display windows 280 and 290 which can be seen via video display screens 240 and 250. In the 

present invention, the video display windows 280 and 290 are movable so that call/conference 
0 participants 200 and 202 can move their respective video display windows 280 and 290 to fixed 
JO predetermined areas within their respective video display screens 240 and 250. Preferably, the 

fixed predetermined areas or bound 

Referring to FIG. 2, an exemplary embodiment of the present invention is shown. Once 
the electronic mail message recipient as shown and described earlier herein has received the 
25 electronic mail message from electronic mail message sender, it is determined if the electronic 
mail message has been opened by electronic mail message recipient, step 210. If the electronic 
mail message has not been opened, no action is taken. If the electronic mail message has been 
opened, video of the electronic mail message recipient is captured, step 220. It is then 
determined if the electronic mail message is no longer being read by electronic mail message 
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recipient, step 230. For purposes of the present invention, the term "no longer being read" may 
have a number of meanings. For example, in one embodiment, "no longer being read" may be 
when the electronic mail message recipient closes the window which contains the electronic mail 
message which the electronic mail message recipient was reading. In another embodiment, "no 
5 longer being read" may mean when the window which contains the electronic mail message 
which the electronic mail message recipient was reading is minimized or overlaid by another 
window. In yet another embodiment, a predetermined time limit may be set to decide when the 
electronic mail message is "no longer being read". For example, a time limit of two minutes may 
be set such that if none of the aforementioned activities, such as the closing or minimizing of the 
10 electronic mail message window occur before two minutes, the electronic mail message will 
qualify as "no longer being read." 

2 Once it is determined that the electronic mail message is no longer being read, the video 

U capture of the electronic mail message is ended or terminated, step 240. An electronic mail 
j!5 message return receipt containing the video of the electronic mail message recipient is provided 
! l to the electronic mail message sender or originator, step 250. In one embodiment of the present 

invention, the return receipt is an electronic mail message sent back to the electronic mail 
ill message sender or originator which contains the video of the electronic mail message recipient as 
o a file attachment. The video captured may be stored in any number of formats such as AVI, 
j>0 MPG, QUICKTIME, REAL VIDEO and other similar formats. In an alternative embodiment of 

the present invention, the video of the electronic mail message recipient may be provided along 

with the electronic mail message return receipt in the form of a link to a video file which may be 

stored remotely, such as on a network server. 

25 In the present invention, software which implements the methods disclosed herein may be 

provided as add-ins to the user's existing e-mail programs or such code to, for example, detect 
the opening and closing of an electronic mail message and activate the video capturing device 
may be transported along with the electronic mail message each time. For example, executable 
code may be provided along with the electronic mail message which is activated upon the 
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opening of an electronic mail message. 

It is contemplated that the present invention may be freely used among friends and associates 
but a security mechanism may be built to prohibit unauthorized or unwanted recording of 
electronic mail message recipients. A prompt may be provided either before or after recording 
which informs the recipient that they have been recorded and whether they wish for the video to 
be sent back to the sender of the e-mail. For example, referring to FIG. 3, a screen may be 
provided after a video is taken of the electronic mail message recipient to have the recipient, for 
example, be able to review the video, cancel the video and/or redo the video. 

Referring to FIG. 4, another embodiment of the present invention is shown. In this 
embodiment, access of an electronic mail message by an electronic mail message receiver is 
detected, step 400. Access can be detected in a number of fashions, such as determining when 
the electronic mail message receiver selects a designated electronic mail message which has a 
return receipts condition attached to it. Upon detection of access, a signal to initiate video 
capture of electronic mail message receiver is provided, for example, to a video capturing 
software facility which is in communication with a video camera, step 410. The end of access of 
the electronic mail message by the electronic mail message receiver is then detected, step 420. 
End of access may be detected in a number of fashions, such as determining when the electronic 
mail message receiver minimizes or closes the designated electronic mail message. Upon 
detecting of the end of access, an electronic mail message return receipt is provided to the 
electronic mail message sender, step 430. 

One exemplary application for the present invention would be for electronic greeting cards 
sent via electronic mail. For example, for birthday greetings, the sender of the electronic mail 
birthday greeting would get a video of the birthday recipient reading their birthday card. Other 
type of special occasion greetings send via electronic mail would be ideal candidates for the 
video enhanced electronic mail message return receipt. 
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While the invention has been described in conjunction with specific embodiments 
thereof, it is evident that many alternatives, modifications and variations will be apparent to 
those skilled in the art. Accordingly, preferred embodiments of the invention as set forth herein 
are intended to be illustrative, not limiting. Various changes may be made without departing 
from the spirit and scope of the invention. 
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